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Abstract 



We provide quantitative bounds for the long time behavior of a class of Piecewise 
Deterministic Markov Processes with state space R'xB where E is a finite set. The 
continuous component evolves according to a smooth vector field that switches at 
the jump times of the discrete coordinate. The jump rates may depend on the whole 
position of the process. Under regularity assumptions on the jump rates and stabil- 
ity conditions for the vector fields we provide explicit exponential upper bounds for 
the convergence to equilibrium in terms of Wasserstein distances. As an example, 
we obtain convergence results for a stochastic version of the Morris-Lecar model of 
neurobiology. 
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1 Introduction and main results 

Piecewise deterministic Markov processes (PDMPs in short) are intensively used 
in many applied areas (molecular biology [ 3TH , storage modelling [7], Internet traffic 
H191 1221 1231 . neuronal activity 11291 |8), populations growth models 1270 ...). Roughly 
speaking, a Markov process is a PDMP if its randomness is only given by the jump 
mechanism: in particular, it admits no diffusive dynamics. This huge class of processes 
has been introduced by Davis (see 0141 1150 ) in a general framework. Several works 
QUI 1181 1 1 211 deal with their long time behavior (existence of an invariant probability 
measure, Harris recurrence, exponential ergodicity...). In particular, it is shown in 111 31 
that the behavior of a general PDMP can be related to the one of the discrete time 
Markov chain made of the positions at the jump times of the process and of an additional 
independent Poisson process. Nevertheless, this general approach does not seem to 
provide guantitative bounds for the convergence to equilibrium. Recent papers have 
tried to establish such estimates for some specific PDMPs (see H10H20l l3ll) or continuous 
time Markov chains (see [9]). 
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In the present paper, we investigate the long time behavior of an interesting subclass 
of PDMPs that plays a role in molecular biology (see 11281 1311 [8j 13510 . We consider a 
PDMP on R d x E where E is a finite set. The first coordinate moves continuously on 
R d according to a smooth vector field that depends on the second coordinate whereas 
the second coordinate jumps with a rate that may depend on the first one. This class 
of Markov processes is reminiscent of the so-called iterated random functions in the 
discrete time setting (see [17] for a good review of this topic). 

Let fibea finite set, (a(-,i,j))ij e E 2 be n 2 nonnegative continuous functions on R d , 
and, for any i e E, F l : R d h-> R d be a smooth vector field such that the ordinary 
differential eguation 

(x' t =F i (x t ), t>0; 
\x = X, 

has a unigue and global solution t H> fl(x) on [0, oo) for any initial condition x € R rf . Let 
us consider the Markov process 

(Z t ) t>0 = ((X t ,I t )) t>0 onR d xE 

defined by its extended generator L as follows: 

Lf(x,i) = (F i (x),V x f(x,i)) + ^2a(x,iJ)(J(x,j) - f(x,i)) (1.1) 

for any smooth function / : R d x E — s- R (see II 1511 for full details on the domain of L). 

Definition 1.1. In the sequel, rj t (resp. /j, t ) stands for the law of Z t = (X t ,I t ) (resp of 
X t ) if (Zt) t>0 is driven by < | 1 . 1 p with initial distribution ij . 

A simple case occurs when a(x,i,j) can be written as X(x,i)P(i,j) for (\(-,i)) ie E 
a set of nonnegative continuous functions, and P an irreducible stochastic matrix, in 
which case: 

Lf(x,i) = (F i (x),V x f(x,i)) + \(x,i) ^2P{i,j)(f(x,j) - f(x,i)). (1.2) 

Let us describe the dynamics of this process in this simple case, the general case being 
similar. Assume that (X ,I ) — (x,i) e R d x E. Before the first jump time T\ of /, the 
first component X is driven by the vector field F l and then X t = (fl(x). The time T x can 
be defined by: 

Ti = inf |t> : J X(X s ,i)ds ^ eA, 

where E\ is an exponential random variable with parameter 1 . Since the paths of X are 
deterministic between the jump times of I, the randomness of Ti comes from the one of 
Ei and 

Ti = infjt>0: J A(^(x), i) ds > EA. 
Remark 1.2. Notice that P( X] £)(Ti = +oo) > if and only if 

r+oo 

/ \(ipl(x) , i) ds < +oo . 
Jo 

If we assume that A := inf( X) i) \(x, i) > then the process / jumps infinitely often. 

At time Ti, the second coordinate / performs a jump with the law P(i, •) and the 
vector field that drives the evolution of X is switched. . . 
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Remark 1.3. In general, I is not a Markov process on its own since its jump rates 
depend on X. In this paper, we will study both the simple — Markovian — case and the 
general case. 

The main goal of the present work is to provide quantitative bounds for the long time 
behavior of ergodic processes driven by ( ] 1 . 2 p thanks to the construction of explicit cou- 
plings. We need to introduce a distance on the set of probability measures to quantify 
this convergence. 

Definition 1.4. LetV p be the set of probability measures onR d x E such that the first 
marginal has a finite p th moment. lfr\£V p and Z is a random variable on R d x E with 
distribution r], we denote by X and I the two coordinates of Z in R d and E respectively 
and by p and v their distributions. 

Let us now define the distance W p on V p as follows: for ry, t) £ V v , 

W p (v,fj)=M (^(e[\X - X\ p jy /P + F(I ^ I) : (X,I)~r)and(X,I)~f} 

The distance W p is made of a mixture of the Wasserstein distance for the first com- 
ponent and the total variation distance for the second one. Recall that for every p ^ 1, 
the Wasserstein distance W p between two laws p and p on R d with finite p th moment is 
defined by 

\ Vp 

\x- x\ p n(dx,dx)) (1.3) 



W p (fM,fl) = ( inf / 



where the infimum runs over all the probability measures II on R d x R d with marginals 
p and p (such measures are called couplings of p and p). It is well known that for any 
p ^ 1, the convergence in W p Wasserstein distance is equivalent to weak convergence 
together with convergence of all moments up to order p. However, two probability 
measures can be both very close in the W p sense and singular. Choose for example 
p = S and p = 5 £ . In this case, 

W p (n,p,) = E and \\p - p\\ TV = 1. 

See e.g. 11301 13411 for further details and properties for Wasserstein distances. 

Estimates for the Wasserstein distances do not require (nor provide) any information 
about the support of the invariant measure (which is the set of the recurrent points). 
This set may be difficult to determine and if the initial distribution of X is not supported 
by this set, the law of X t and the invariant measure may be singular. To illustrate this 
fact, one can consider the following trivial example: 

(x,i) £ R 2 x {0,1}, X(x,i) = l, F i (x) = -(x-ia) with a =(1,0). 

The process (X, I) is ergodic and the first marginal \i of its invariant measure is sup- 
ported by the segment {pa ; p £ [0, 1]} (it is shown in |7] that p is a Beta distribution). 
Despite its extreme simplicity, this process does not in general converge in total varia- 
tion: if Z = (0, 1), the law of X t is singular with the invariant measure for any t ^ 0, so 
\\C(X t ) — p\\ T y is always equal to 1. On the contrary, W p (C(X t ), p) goes to exponen- 
tially fast (see below). 

We are able to get explicit rates of convergence in two situations. Firstly, if the 
jump rates of / does not depend on X, then the vector fields (F l ) ieE will be assumed to 
satisfy an averaged exponential stability. Secondly, if the jump rates of I are assumed 
to be Lipschitz functions of X, then the vector fields (F l ) ieE will be assumed to satisfy 
a uniform exponential stability. 
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Remark 1.5. These conditions are not necessary to ensure the ergodicity of Z. In 0, 
it is shown that, for constant jump rates and under Hormander-like conditions on the 
vectors fields (F l ) ieE , the invariant probability measure is unique and absolutely con- 
tinuous with respect to the Lebesgue measure on R d . In a similar setting, exponential 
rates of convergence to equilibrium are obtained in ||6). But these estimates rely on 
compactness arguments and are not explicit. 



1.1 Constant jump rates 

If the jump rates of I do not depend on X, then (It) t > is a Markov process on the 
finite space E and {X s ) 0<s<f is a deterministic function of (I s ) 0<s<t - Many results are 
available both in the discrete time setting (see H261 1331 I2T1 1251 [Til) and in the continuous 
time setting (see [241 1161 l4ll). Moreover, if Assumption [TH] (see below) does not hold, 
provides a simple example of surprising phase transition for a switching of two 
exponentially stable flows that can be explosive (when the jump rates are sufficiently 
large). 

Assumption 1.6. Assume that the jump rates (a(-, i, j))ieE do not depend on x and that 
/ is an irreducible Markov process on E. Let us denote by v its invariant probability 
measure. 

Remark 1.7. If a(-,i,j) does not depend on x, we can always write a(i,j) = \(i)P(i,j) 
with P(-, •) a Markov transition matrix. 

Assumption 1.8. Assume that for any i £ E, there exists a(i) £ 1R such that, 

{x-x.F^x) - F\x)) sc -a(i)\x-x\ 2 , x,x £ R d , 

and that 



E 



a(i)v{i) > 

E 

where v is defined in Assumption [TT6] 

Firstly, one can establish that the process X is bounded in some L p space. 



Lemma 1.9. Under Assumptions 1.6 and 1.8 there exists k > such that, for any q < k, 



the function t m> E(|X t | 9 ) is bounded as soon as E(|X | ) is finite. More precisely, there 
exists M (q, m) such that 

suplE(|X t H < M{q,m), 

as soon as E(|X | 9 ) ^5 m. 

Let us now turn to the long time behavior estimate. 

Theorem 1.10. Assume that Assumptions \ 1 . 6\ and \ 1 . 8\ hold. Let p < q < n and denote 
by s the conjugate of q: q^ 1 + s^ 1 = 1. Assume that po and po admit a finite q th moment 
smaller than m. Then, 

W p (Th,ik) < 2P +1 M(q,mr^C 2 (p)exp /p *), 

where p and 9 P are positive constants depending only on the Markov chain I. 

The constants p, 9 P and C*2(p) are given below in Equations ( |2.1[ l, ( |2.2| l and l |2.3[ ). 



Corollary 1.11. Under the hypotheses of Theorem 1.10 the process Z admits a unique 
invariant measure and 

Wp(Vt,Voo) < V +1 M{q,mY^C 2 {p)e^> //? *)- 
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1.2 Non constant jump rates 

Let us now turn to the case when the jump rates of I depend on X. We will assume 
that the a(x, i, j) are smooth in the x variable and that each vector field F l has a unique 
stable point. 

Assumption 1.12. There exist a > and k > such that, for any x, x G K. d and i, j e E, 

a(x,i,j)^a and ^""^ \a(x,i,j) — a(x,i,j)\ ^ k\x — x\. 

The lower bound condition insures that the second — discrete — coordinate of Z 
changes often enough (so that the second coordinates of two independent copies of 
Z coincide sufficiently often). This is a rather strong condition that can be relaxed in 
certain situations. If for example a(x,i,j) — X(x, i)Pij as in < |1 -2| , Lipschitz continu- 
ous A bounded from below and an aperiodic P are sufficient to get a similar rate of 
convergence. 

Assumption 1.13. Assume that there exists a > such that, 

(x-x,F t (x)~F l {x)) ^~a\x-x\ 2 , x, x e R d , i € E. (1.4) 
Assumption |1 . 1 3| ensures that, for any i e E, 

\<p\{x) - <p\(x)\ ^e' at \x-x\, x,xeR d . 

As a consequence, the vector fields F l has exactly one critical point e R d . Moreover 
it is exponentially stable since, for any x € R d , 

\y\{x)-a{i)\ ^e- at \x-a(i)\. 

In particular, X cannot escape from a sufficiently large ball (this implies that the (con- 
tinuous) functions a(-,i,j) are also bounded from above along the trajectories of X). 
More precisely, the following estimate holds. 

Lemma 1.14. Under Assumptions ]! . 1 2\ and \ 1 . 1 3\ the process Z cannot escape from the 
compact set B(0, t) x E where B(0, r) is the (closed) ball centered in e M, d with radius 
r given by 

max !eB |F l (0)| 



a 

Moreover, if\X \ > r then 



(1.5) 



(\X t \ 2 -r 2 ) + ^e- at [\ 



"*o| 2 -r 2 



In particular the support of any invariant measure is included in B(0 7 r). 

Let us now state our main result which establishes the quantitative exponential er- 



godicity of the process Z under Assumptions 1.12 and 1.13 



Theorem 1.15. Assume that Assumptions \1.12\ and \1.13\ hold and that the supports of 
yUo and jlo are included in the ball B(0, r) where r is given by {L5). Then there exist 
positive constants c and 7 such that 

Wx(r)t,fj t ) sC (l + 2r)(l + ct)exp 

where a is derived from (II. 4b. 



1 + a/7 
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The constants obtained in the proof are the following 



(a + b) — y/(a + b) 2 — Abpa a epab 

7 = — and c — 



+ 7 y/(a + b) 2 - Abpa 

with p = e - 2rK / a and e = exp(l) and where b depends on the coalescence time of two 
independent processes defined on E as the second coordinates of independent copies of 
Z. To obtain this result we couple two paths of our process and compare their distance 
to a real-valued process that can pass instantly (less and less often) from small to large 
values (2?'+l). This may seem rough, but in the general case, nothing much better can 
be done : if one of the flows is very strongly attractive, two paths may indeed very 
rapidly diverge. For particular examples, or under additional assumptions on the flows, 
it must be possible to get better rates. 

Corollary 1.16. Under the hypotheses of Theorem ( |1.15[ l, the process Z admits a 
unique invariant measure ri^ and 

Wifo.Jfeo) s? (l + 2r)(l + ct)exp (~ 1+ ^ 7 *)- 

Section [2] is dedicated to the proof of Theorem |1.10| Theorem |1.15| is established 
in Section [3] As an example of the applicability of this result, we show in Section [4] 
that the stochastic version of the Morris-Lecar model introduced in H35II satisfies our 
assumptions, so that explicit bounds may be obtained for its convergence to equilibrium. 

2 Constant jump rates 

The aim of this section is to prove Theorem |1.10| Assumption |1.6| ensures that 
(J t ) t>0 is an irreducible Markov process on the finite space E. Its generator A is the 
matrix defined by A(i, i) = —X(i) and A(i,j) = X(i)P(i,j) for i ^ j. Let us denote by 

its unique invariant probability measure. The study of the long time behavior of 
I is classical: since I takes its values in a finite set, it is quite simple to construct a 
coalescent coupling of two processes starting from different points. 



Lemma 2.1 ([32]). If Assumption 1.6 holds then there exists p > such that for any 

i,3 G E, 

P(T > t\I = i, Jo = j) < e- pt (2.1) 

where (Jt) t>0 an( l (Jt)t>o are ^ wo independent Markov processes with infinitesimal gen- 
erator A starting respectively at i and j and T = inf |t ^ : I t = Jt| is the first inter- 
section time. 

Remark 2.2. If E — {1,2}, then the first intersection time is distributed as an ex- 
ponential random variable with parameter A(l) + A(2) and Equation l |2.1[ l holds with 

P = A(1) + A(2). 

The proof of Theorem [TTTO] is made of two steps. Firstly we couple two processes 
starting respectively from (x, i) and (x, i) to get a simple estimate as time goes to infinity. 
Then we use this estimate and Lemma [2~T] to manage the general case. 
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2.1 Moments estimates 



In this section we prove Lemma 1.9 and get an L p estimate for \X t \. For any p ^ 2 
and e > 0, 

^\X t f=p\X t r 2 (X t ,F^(X t )) 

= p\X t \ p - 2 {X t , F 1 * (X t ) - F 1 * (0)) + p\X t \ p - 2 {X u F 1 * (0)) 
< -(pa(I t )-e)\X t \ p + C(p,s). 

Thanks to Gronwall's Lemma, we get that 

E(|X t | p ) C(p,e) J E^e-^(f«(^)- e )^ ds + E(|X | p )E(e~-''o (pQ(/ " ) - £)d "). 

Remark 2.3. A similar estimate can be obtained for p e [1, 2) using a regularization of 
the application x H> \x\ p . 

The right hand side depends only on E(|X | P ) and (I s )o< 3 <r Thus, it is sufficient to 
investigate the behavior of e(p, t) defined for any t > by 



e(p, t) — maxEi ( exp — / pa(I u ) du 

^ E V V Jo 



This study has been already performed in ||4). Let us state the precise result. We denote 
by A p the matrix A — pB where A is the infinitesimal generator of / and B is the diagonal 
matrix with diagonal (a(l), ■ ■ ■ , a(n)) and associate to A p the guantity 

p := — max Re 7. (2.2) 

7£Spcc(A p ) 

The long time behavior of e(p, t) is characterised by 9 p as follows. For any p > 0, there 
exist < C\ (p) < 1 < C 2 (p) < +00 such that, for any any t > 0, 

Cx{p)e- 6 ^ < e(p,t) < C 2 (p) e -<H (2.3) 

Moreover the following dichotomy holds: 

• if a ^ 0, then p > for all p > 0, 

• if a < 0, there is k e (0,min{v4.jj/o;(z) : a(z) < 0}) such that 8 P > for p < k and 
0p < for p > k. 

See lO for further details. 

If p < k, then t H> E(|X t | p ) is bounded as soon as E(|X | P ) is finite. This concludes 
the proof of Lemma [TT9"| 



2.2 Convergence rate 

Let us now get the upper bound for the Wasserstein distance W p for some p < n. 
Assume firstly that the initial law are two Dirac masses at (x, i) and (x, i). It is easy to 
construct a good coupling of the two processes (X,I) and (X,I): since the jump rates 
of I do not depend on X, one can choose I and I egual! As a conseguence, for any 

P^ 2, 

j t \X t - X t \ p =p\X t - X t r 2 (x t - X t ,F^(X t ) - F**(X t ) 
t:-pa(I t )\X t -X t \P. 
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As a consequence, 

E(\X t -X t \P^ <E/expf-pjf a(I s ) ds^ \x - x \ p 

Let us now turn to a general initial condition. Choose (x,i) and (x,j) in M d x E 
and consider the following coupling: the two processes evolve independently until the 
intersection time T of the second coordinates. Then, I and / are chosen to be equal for 
ever: 

P(/ t ^ h) = P(T > t) e-"* 

by d 2 . 1 [ > . This term will turn to be negligible in W p (?7t,rjit). Now fix t > and /3 e (0, 1) 
and decompose: 

e(|x 4 - = e(|x 4 - l t p>i {r>/3t} ) + e(|x 4 - x t \n {T<pt} ) . 

Choose g e (p, k) and define r = q/p and s as the conjugate of r. By Holder's inequality 
and Lemma [L9] we get 

E(|X t - X t | p l {T>m ) < E(|X t - X t | 9 ) P V(T ^ /3t) 1/s 

Moreover, 

E(|X ( - l t | p l {r<m ) = E(jX T - X T |"E /r (^exp (^~pj^a(l s ) ds^j ^ l {T </w}) 
< 2 J 'Af(p,m)C 2 (p)e-^ (1 - /3)t . 
At last, one has to optimize over /3 e (0, 1). With 



9 P + p/.s' 

one has 

E(|X t - l t | p ) < 2P +1 Af((7,m)^C 2 (p)exp (~ g 
This concludes the proof of Theorem |1.10| 

3 Non constant jump rates 

Let us now turn to the proof of Theorem |1.15| In this section we do not assume 
that the jump rates depend only on the discrete component. Thus, the coupling is more 
subtle since once I and / are equal, they can go apart with a positive rate. The main 
idea is the following. If / and / are equal, the distance between X and X decreases 
exponentially fast and then it should be more and more easier to make the processes 
I and / jump simultaneously (since the jump rates are Lipschitz functions of X). This 
idea has been used in a different framework in ||101 l3ll. 

This section is organized as follows. Firstly we prove Lemma [114| that ensures that 
the process X cannot escape from a sufficiently large ball. In particular, the support of 
the invariant law of X is included in this ball. Then we construct the coupling of two 
processes Z = (X, I) and Z = (X, I) driven by the same infinitesimal generator ( |1.2[ ) 
with different initial conditions. At last we compare the distance between Z and Z to 
an companion process that goes to exponentially fast. 
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Proof of Lemma [1.14\ Setting x = in ( |1.4[ l ensures that, for e e (0, a), 

(F l (x),x) < -a|a;| 2 + (F l (0), s) < -(a - e)\x\ 2 + M/(4e), 

l 1 2 

if M = max iS £: F 4 (0) . In other words, 

2<F / "(X ll ),X M ) C ^ -2(a-e) y |X U | 2 du + — (t - s). 

As a consequence, 

\X t \ 2 < ^7^(1 - e~ 2 ^ >*) + \X \ 2 e-^K 
Choosing e = a/2 ensures that 

In particular, X cannot escape from the centered closed ball with radius r = \/M/a. □ 
3.1 The coupling 

Let us construct a Markov process on (R d x E) 2 with marginals driven by fll.2| l 
starting respectively from (x, i) and (x,j). This is done via its infinitesimal generator £ 
which is defined as follows: 

• if i £ j 

£/(z, i, x, j) =(F i (x),VJ(x, i, x, j)) + (F j (x), V £ f(x, i, x,j)) 

+ ^2 ^m'X/OM',^ j) - f(x,i,x,j)) 

i'EE 

+ ^2 a (^3>3')(f(x,y,x,j') - f(x,y,x,j)). 

j'EE 

• if i = j: 

Zf(x,i,x,j) =(F i (x),V x f(x,i,x,i)) + (F*(5),V a /(;M.M)) 

+ ^2 ( a ( x > *> A OX/fa) *j - 5) *)) 

i'G-E 

where (■)+ and (•)" stand respectively for the positive and negative parts. Notice that 
if / depends only on (a;, i) or on (x,j), then £/ = A/. Let us explain how this coupling 
works. When / and / are different, the two processes (X, I) and (X, I) evolve indepen- 
dently. If I = I then two jump processes are in competition: a single jump vs two simul- 
taneous jumps. The rate of arrival of a single jump equals to YIv&e \ a ( x i h — a (^j h 01- 
It is bounded above by k\x — x\. The rate of arrival of a simultaneous jump is given by 
T,i>eE( a ( x > i > i ') A a(x,i,i')). 

Assume firstly that X and X Q belong to the ball 5(0, r) where r is given by ( |1.5[ l. 
Let us define, for any t ^ 0, 

A t = \X t -X t \ + l {lt7tit} . 
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The process (A t ) t>0 is not Markovian. Nevertheless, as long as I = I, A decreases 
with an exponential rate which is greater than a. If a single jump occurs, then A is 
increased by 1 and it can continuously increase (since the continuous parts are driven 
by two different vector fields). Nevertheless A is bounded above by D + 1 with D = 2r. 
At the next coalescent time T c of two independent copies of I, A jumps to A — 1 and then 
decreases exponential fast once again (as long as the discrete components coincide). 
There exists b > such that T c is (stochastically) smaller than £{b) (for example, if 
E = {0, 1}, then T c is egual to the minimum of the jump times of the two independent 
processes which are both stochastically smaller than a random variable of law £ (a) and 
T c is stochastically smaller than £ (2a)). Then E(A t ) ^ E(£/ t ) where the Markov process 
(U t ) t>0 on [0, D] U {D + 1} is driven by the infinitesimal generator 



Gf{x) 



\-axf(x) + Kx(f(D + l)-f(x)) ifxe [Q,D], 



\b(f(D)-f(D + l)) 



if x = D + l. 



3.2 The companion process 
Theorem 3.1. For any t ^ 0, 

E(U t \Uo = D) < \D + (D + 1)( P abe = ]^_] exp f 1 at \ (31) 

^ \y/(a + b) 2 - Apab + \ 1 + a/j J 

where 

_ D , (a + b)- y/(a + b) 2 ~ Apab (a + b) - y/(g - 6) 2 + 4(1 - p)ab 

p = e 1 and 7 = = . 

'2 2 

Remark 3.2. If a goes to 00, then 7 goes to d whereas 7 ~ pa/b if 6 goes to 00. 

Proof. Starting from D + 1, the process [/jumps after a random time with law £(b) to d 
and then goes to zero exponentially fast until it (possibly) goes back to D + 1. The first 
jump time T starting from D can be constructed as follows: let £bea random variable 
with exponential law £ (1). Then 

1 , / aE\ Dk 
, r c 1— log 1-— ifE<— , 

-00 otherwise. 



Indeed, conditionally on {Uo = D}, 



/*£ I ■) 

X(V s )ds= / dner as ds= — (l-e- Qt ). 
10 Jo a 

In other words, the cumulative distribution function Ft of T is such that, for any t > 0, 



1 - F T (t) = P(T > t) = cxp (1 - e~ at ) 

V a 

Let us define p = e~ DK / a . The law of T is the mixture with respective weights p and 
1 — p of a Dirac mass at +00 and a probability measure on R with density 

/ : t h+ /(<) = ^e-V^-^V+oo)^) ( 3 - 2 ) 
1 — p v 

and cumulative distribution function 

/N /l-exp(-^(l-e- Qt ))\ 
F : t^F(t)= f 1 _ cx ; ( _j^ ) ^ )l(o. + oo)(t). 
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Starting at D, U will return to D with probability 1 —p. The Markov property ensures 
that the number N of returns of U to D is a random variable with geometric law with 
parameter p. The length of a finite loop from D to D can be written as the sum S + 
E where the law of S has the density function / given in H3.2[ ), the law of E is the 
exponential measure with parameter b and S and E are independent. 

Lemma 3.3. The variable S is stochastically smaller than an exponential random vari- 
able with parameter a i.e. for anyt ^ 0, F(t) > F a (t) where F a (t) = (1 — e~ at )l{ t>0 }. 



Proof. For any t ^ 0, 



; - (,x,)(/ ';ir ! , ' • "' = 

exp(^) - 1 



This ensures the stochastic bound. □ 

As a consequence, the Laplace transform Ls of S with density / is smaller than the 
one of an exponential variable with parameter a: for any s < a, 

L S (s) < ■ 

a — s 

If L e is the Laplace transform of S + E, then, for any s < a A b, we have 

, , , a b 
L e (s) sc 



o 



-s6- 



Let us denote by H the last hitting time of d i.e. the last jump time of U and by L its 
Laplace transform. Let us introduce ~ G(p), (£i)i>i with density / and (E i ) i>l with 
law £(b). All the random variables are assumed to be independent. Then 



N 

C 



i=i 

Classically for any set such that (1 — p)L e (s) < 1, one has 
L(s) = E(e s 



pL e (s) 



l-(l-p)i e («) l-pVl-(l-p)£ e (8) 

Let us denote by 



(a + b) - J (a + b) 2 - Apab (a + b) + J (a + b) 2 - Apab 
7= g and 7 = 

the two roots of £ 2 — (a + b)£ +pab = 0. Notice that 7 < a A b < 7. For any s < 7, one 
has (1 — p)L e (s) < 1 and 

r / x ^ Pab pab 1 

£(s) < 7 ^ 7 < ~ • (3.3) 

(7 — s) (7 — s ) 7 — s 7 — s 

Let us now turn to the control of E([/ t |[/o = -D). The idea is to discuss whether 
H > f3t or not for some /3 € (0, 1) (and then to choose f3 as good as possible): 

• if H < fit, then U t < e-^ 1 -- 9 ) *, 

• the event {H ^ /?<} has a small probability for large t since H has a finite Laplace 
transform on a neighbourhood of the origin. 
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For any e (0, 1) and s > 0, 

E(U t \U =D) = E(l7 t l {T</w} ) + E(C/ t l {T>w ) 

sC De- {1 -^ at + (D + l)L(s)e- s(3t . (3.4) 

From Equation l [3.3| l, we get that, for any s < 7, logL(s) — /3ts < h(s) where 

h(s) = log (J—-) - log(7 - s) ~ fits. 



.1-1, 

The function h reaches its minimum at s(t) = 7 — {Pt)^ 1 and 

h(s(t)) = log (^-) + \og(pt) + 1 - 7/3*. 

For t > and /3 G (0, 1), choose s(t) = 7 - (/3i) _1 in < f3T4] > to get 

E([/ t |£/ = D) < Oe- (1 ^» Qi + (13 + l)^* 7 ^ 

< De~^ at + (D + 1) f |^W-^*. 

At last, one can choose /3 = a(a + in order to have (1 — (3)a — 7/?. This ensures that 

E(U t \U =D)*(d + (D + 1)(^)-?L) exp f-^U 
V \7 — l/ a + lj V « + 7 

Replacing 7 — 7 by its expression as a function of a, b and p provides ( |3.1[ l. □ 



4 Example 

The Morris-Lecar model introduced in (281 describes the evolution in time of the 
electric potential V(t) in a neuron. The neuron exchanges different ions with its en- 
vironment via ion channels which may be open or closed. In the original — determin- 
istic — model, the proportion of open channels of different types are coded by two 
functions m(t) and n(t), and the three quantities m, n and V evolve through the flow of 
an ordinary differential equation. 

Various stochastic versions of this model exist. Here we focus on a model described 
in 11350 . to which we refer for additional information. This model is motivated by the 
fact that m and n, being proportions of open channels, are better coded as discrete 
variables. More precisely, we fix a large integer K (the total number of channels) and 
define a PDMP (V, tii,u 2 ) with values in R x {0, \/K,2/K . . . , l} 2 as follows. 

Firstly, the potential V evolves according to 



3 

(4.1) 



dt C , 

where C and / are positive constants (the capacitance and input current), the gt and 
Vi are positive constants (representing conductances and equilibrium potentials for dif- 
ferent types of ions), u 3 (t) is equal to 1 and Ux(t), u 2 (t) are the (discrete) proportions of 
open channels for two types of ions. 

These two discrete variables follow birth-death processes on {0, 1/K, . . . , 1} with 
birth rates a\, a 2 and death rates /3i, /3 2 that depend on the potential V: 

fV - V'\ ( (V - V 

a t (V) = Cl cosh f 1(1 + tanh ( — ^ 

V i / \ \ i / / (4 7 1 

MV) = Cl cosh ( J (l - tanh ( — * 
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where the c, and V-, V" are constants. 

Let us check that our main result can be applied in this example. Formally the 
process is a PDMP with d — 1 and the finite set E = {0, 1/K, . . . , l} 2 . The discrete 
process (ux, u 2 ) plays the role of the index i e E, and the fields F < - Ul - U2 ' ) are defined (on 
R) by ( |4.1| l by setting ui(t) = m, u 2 (t) = u 2 . 

The constant term u 3 g 3 in ( |4.1| l ensures that the uniform dissipation property ( |1.4| l 
is satisfied: for all (ui : u 2 ), 



The Lipschitz character and the bound from below on the rates are not immediate. 
Indeed the jump rates ( |4.2| l are not bounded from below if V is allowed to take values 
in R. 

However, a direct analysis of ( |4.1| l shows that V is essentially bounded : all the fields 
p{ui,u 2 ) point inward at the boundary of the (fixed) line segment S = [0, max(Vi, Vz, V 3 + 
(J + l)/g 3 u 3 )], so if V(t) starts in this region it cannot get out. The necessary bounds all 
follow by compactness, since ati(V) and A(V) are C 1 in S and strictly positive. 
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